#data extraction

Current language model training leaves large parts of the internet on the table

A new study reveals that the tools used to extract web content for training large language models can significantly impact which parts of the internet are included in AI datasets. This inconsistency raises concerns about the representativeness and fairness of AI training data.